ADMM Algorithmic Regularization Paths for Sparse and Large Scale Positive-Definite Covariance Matrix Estimation
نویسندگان
چکیده
Estimating sparse positive-definite covariance matrices in high dimensions has received extensive attention the past two decades. However, many existing algorithms are proposed for a single regularization parameter and little been paid to estimating over full range of parameters. In this paper we suggest compute paths through one-step approximation warm-starting Alternating Direction Method Multipliers (ADMM) algorithm, which quickly outlines sequence solutions at fine resolution. We demonstrate effectiveness computational savings our algorithm elaborative analysis simulated examples.
منابع مشابه
ADMM Algorithmic Regularization Paths for Sparse Statistical Machine Learning
Optimization approaches based on operator splitting are becoming popular for solving sparsity regularized statistical machine learning models. While many have proposed fast algorithms to solve these problems for a single regularization parameter, conspicuously less attention has been given to computing regularization paths, or solving the optimization problems over the full range of regularizat...
متن کاملAutomatic positive semi-definite HAC covariance matrix and GMM estimation
This paper proposes a new class of HAC covariance matrix estimators. The standard HAC estimation method re-weights estimators of the autocovariances. Here we initially smooth the data observations themselves using kernel function based weights. The resultant HAC covariance matrix estimator is the normalised outer product of the smoothed random vectors and is therefore automatically positive sem...
متن کاملLarge-scale l0 sparse inverse covariance estimation
There has been significant interest in sparse inverse covariance estimation in areas such as statistics, machine learning, and signal processing. In this problem, the sparse inverse of a covariance matrix of a multivariate normal distribution is estimated. A Penalised LogLikelihood (PLL) optimisation problem is solved to obtain the matrix estimator, where the penalty is responsible for inducing...
متن کاملPositive-Definite l1-Penalized Estimation of Large Covariance Matrices
The thresholding covariance estimator has nice asymptotic properties for estimating sparse large covariance matrices, but it often has negative eigenvalues when used in real data analysis. To fix this drawback of thresholding estimation, we develop a positive-definite l1penalized covariance estimator for estimating sparse large covariance matrices. We derive an efficient alternating direction m...
متن کاملPositive-Definite 1-Penalized Estimation of Large Covariance Matrices
The thresholding covariance estimator has nice asymptotic properties for estimating sparse large covariance matrices, but it often has negative eigenvalues when used in real data analysis. To fix this drawback of thresholding estimation, we develop a positive-definite 1penalized covariance estimator for estimating sparse large covariance matrices. We derive an efficient alternating direction me...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Wuhan University Journal of Natural Sciences
سال: 2022
ISSN: ['1007-1202', '1993-4998']
DOI: https://doi.org/10.1051/wujns/2022272128